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ABSTRACT 



In a fine photo mode, a camera photographs a series of 
frames from the same scene upon one depression of a release 
button, and records data of correlation between the frames of 
the same scene in association with the series of frames. 
When a printer reads the correlation data, the printer com- 
poses a high definition image from image data of the series 
of frames, and make a print of the high definition image. A 
literal photo mode may be selected for a scene containing a 
literal image. The camera records data representative of the 
literal photo mode in association with the frame taken in the 
literal photo mode, so the printer processes image data to 
improve sharpness and resolution of the literal image of the 
frame, and makes a hard copy of the literal image from the 
processed image data. 

14 Claims, 10 Drawing Sheets 
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PHOTOGRAPHIC SYSTEM FOR 
RECORDING DATA AND REPRODUCING 
IMAGES USING CORRELATION DATA 
BETWEEN FRAMES 

s 

This is a division of application Ser. No. 08/955,178 filed 
Oct. 21, 1997, now abandoned the entire disclosure of which 
is incorporated herein by reference. 

BACKGROUND OF THE INVENTION 10 

1. Field of the Invention 

The present invention relates to a photographic system 
consisting of cameras and printers, wherein the camera 
records photographic data on a recording medium, e.g. 
magnetic recording layer on photo filmstrip or a memory 15 
card or the like, in association with individual image frames, 
and the printer controls printing according to the photo- 
graphic data. 

2. Background Arts 2Q 
In the conventional photographic system, granularity or 

graininess of a photo print is deteriorated as the degree of 
enlargement increases. This is because there is a limit in 
grain size or coarseness of grain on the silver-salt photo film. 
The same problem occurs in the digital cameras because of 25 
resolution limit of the imaging device such as a CD. 

To provide a fine granularity large size photo print, a large 
size silver-salt camera or a digital camera with a high 
resolving power imaging device is necessary. In either case, 
the size of camera is inevitably enlarged. In those large size 30 
camera, it is difficult to reproduce high brightness images 
and low brightness images with high definition. 

The conventional photographic system is not suitable for 
recording documents because characters are photographed 
and processed in the same way as other ordinary image 35 
frames, and all the frames are printed on photographic paper 
regardless of whether they includes characters or not. 
Therefore, the contrast and resolution of the characters are 
inadequate to read, and the photographic paper is not suit- 
able for treating as the document in terms of surface material 40 
and size. 

SUMMARY OF THE INVENTION 

To achieve the above objects, a photographic system 
according to the present invention uses a camera having a 45 
fine photo mode. In the fine photo mode, a series of frames 
are photographed from the same scene, and the camera 
records data of correlation between the frames of the same 
series in a data recording medium. When a printer reads the 
correlation data from the data recording medium, the printer 50 
composes a high quality image from image data of the series 
of frames, and makes a print of the high quality image. 

According to another photographic system of the present 
invention, a literal photo mode is provided for a scene 
containing a literal image. The camera records data rep re- 55 
sentative of the literal photo mode in association with each 
frame taken in the literal photo mode. When a printer reads 
the data representative of the literal photo mode, the printer 
processes image data to improve the resolution and contrast 
of the literal image of the frame, and makes a hard copy of 60 
the literal image from the processed image data. Thus, the 
hard copy of the literal image has a sufficient quality enough 
for use as a document or letter. 

BRIEF DESCRIPTION OF THE DRAWINGS 65 

The above and other objects and advantages of the present 
invention will become apparent from the following detailed 
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description of the preferred embodiments when read in 
connection with the accompanying drawings, which are 
given by way of illustration only and thus are not limitative 
of the present invention, wherein like reference numerals 
designate like or corresponding parts throughout the several 
views, and wherein: 

FIG. 1 is a block diagram of a digital still camera for use 
in a photographic system according to a first embodiment of 
the invention; 

FIGS. 2A, 2B, 2C and 2D are explanatory views illus- 
trating a divisional photo mode of the first embodiment; 

FIGS. 3A, 3B, 3C and 3D are explanatory views illus- 
trating a stepped zooming mode of the first embodiment; 

FIG. 4 is a block diagram of a digital printer unit for use 
in the photographic system of the first embodiment; 

FIG. 5 is a schematic diagram of a printer adop table in the 
digital printer unit of FIG. 4; 

FIG. 6 is a flow chart illustrating an operation of the 
digital still camera of FIG. 1; 

FIG. 7 is a schematic diagram of a camera for use in a 
photographic system according to a second embodiment of 
the invention; 

FIGS. 8A, 8B, 8C and 8D are explanatory views illus- 
trating original frames and hard copies made firom these 
frames according to the photographic system of the second 
embodiment; 

FIG. 9 is a printer-processor for use in the photographic 
system of the second embodiment; 

FIG. 10 is a flow chart illustrating an operation sequence 
of the camera of FIG. 7; and 

FIG. 11 is a flow chart illustrating an operation sequence 
of the printer-processor of FIG. 9. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 

Referring to FIG. 1, a digital still camera 10 is constituted 
of an imaging section 11, an image processing section 12, a 
buffer memory 13, a system controller 14, and an image data 
writing section 15. The imaging section 11 picks up analog 
image signal from a subject. The image processing section 
12 subjects the image signal to the gamma conversion and 
other well-known image processing steps, and converts it 
into digital image data. The buffer memory 13 stores the 
image data temporarily. 

In the image data writing section 15, the image data read 
out from the buffer memory 13 is compressed frame by 
frame at a ratio of 1/10 to 1/20 according to JPEG (Joint 
Photographic Experts Group) method. The compressed 
image data is written frame by frame in an I C memory card 
16. The image data may be compressed according to another 
known method. 

The system controller 14 may be a microcomputer which 
is provided with MPU 17, RAM 18, ROM 19 another 
well-known components, and also a data input section 20 for 
selecting a photographic mode and entering photographic 
data, and a display device 21 for displaying the photographic 
data and the photographic mode. In addition, a release 
button and other operation members of the camera 10 are 
connected to the system controller 14. The data input section 
20 is provided with a plurality of push button switches. The 
ROM 19 stores a program for sequentially controlling the 
entire operation of the camera 10. The imaging section 11 
consists of an imaging lens 22, a lens shifting device 23, a 
zooming device 24, and an image area sensor 25, e.g. a 
single-plate type or a triple-plate type CCD image area 
sensor. 
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The camera 10 may be manually set in a photo mode, 
including an ordinary photo mode where a photographic 
scene is recorded in a full size frame upon one actuation of 
the release button, and a fine photo mode. The fine photo 
mode includes a divisional photo mode, a stepped zooming 
mode, a stepped focusing mode, a stepped exposure value 
mode, a successive exposure mode, and a pixel shifting 
mode, in each of which a photographic scene is recorded in 
a plurality of frames under a series of different photographic 
conditions in response to one shutter release operation. 

In the divisional photography mode, a photographic scene 
is divided into a number of divisions in a predetermined 
arrangement, so each division is photographed as a photo- 
graphic field in a full size frame by use of the entire imaging 
surface of the imaging section 11. For example, as shown in 
FIGS. 2A to 2D, a photographic scene S is divided into four 
divisions SI, S2, S3 and S4, and four frames FS1, FS2, FS3 
and FS4 are sequentially photographed from the respective 
divisions SI to S4. In association with each of these four 
frames FS1 to FS4, position data of the corresponding 
division SI to S4 within the scene S is recorded. For 
example, the position data represents relative coordinate 
values. The number of divisions is not to be limited to four, 
but may be two, six, eight, nine, twelve and so on. 

In the divisional photography mode, the lens shifting 
device 23 moves the imaging lens 22 horizontally and/or 
vertically in a perpendicular plane to its optical axis so as to 
concentrate on one division after another, and then the 
zooming device 24 zooms up the imaging lens 22 to form an 
image of the one division on the entire imaging surface of 
the image area sensor 25. The amounts of horizontal and 
vertical movements and the zooming amount are predeter- 
mined for each division according to the number and 
arrangement of divisions, and are previously written in the 
ROM 19. Focusing is made division by division, or may be 
made scene by scene. It is also possible to manually preset 
a focusing range prior to the shutter release or select a 
focusing range by well-known focus-locking. The focus- 
locking is effected by depressing the release button halfway 
while locating a subject of an appropriate distance in the 
center of photographic field, and keeping the release button 
depressed halfway while framing an appropriate scene struc- 
ture. In most cases, it is preferable to use the same exposure 
amount for each division of the same scene. As for extreme 
back-lit scenes, however, it may be preferable to change the 
exposure amounts for the individual divisions. In that case, 
data of the exposure amounts should be recorded as photo- 
graphic data. 

As the position data of the individual division, it is 
possible to use a simple serial number instead of the relative 
coordinate values. For example, if the scene S is the third 
scene in the sequence of recording in the memory card 16, 
the frames FS1 to FS4 are allotted with serial numbers 
"3-1", "3-2", "3-3" and "3-4" respectively. 

In the stepped zooming mode, the photographer first 
determines a focusing range by focus-locking at a main 
subject and then determines an appropriate scene structure 
by framing. Thereafter when the shutter is released by 
depressing the release button to the full, the camera 10 
detects the direction and amount of movement from the 
focus-locked position to the shutter released position 
through a not-shown sensor, and writes data of the camera 
movement in the RAM 18. 

As shown for example in FIGS. 3 A to 3D, upon full 
depression of the release button, the camera 10 sequentially 
photographs four frames FSZ1, FSZ2, FSZ3 and FSZ4 
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respectively from four different photographic fields SZ1, 
SZ2, SZ3 and SZ4. The first photographic field SZ1 covers 
the entire scene SZ. After taking the first photographic field 
SZ1, the imaging lens 22 is moved perpendicularly to the 

5 optical axis by the lens shifting device 23 into a position 
where the main subject is on the optical axis of the imaging 
lens 22, while the camera 10 frames the same scene SZ. The 
direction and amount of movement of the imaging lens 22 is 
determined based on the camera movement data written in 

10 the RAM 18. Thereafter, the second to fourth photographic 
fields SZ2 to SZ4 are photographed while the zooming 
device 24 varies focal length of the imaging lens 22 in three 
steps from a default value that is used for the first photo- 
graphic field SZ1. 

15 The stepped zooming frames FSZ1 to FSZ4 are sequen- 
tially stored in the memory card 16 along with photographic 
data: data indicating that these frames FSZ1 to FSZ4 are 
taken in the stepped zooming mode and data of the focal 
length or image magnification used for each frame FSZ1 to 

20 FSZ4, The number of zooming steps or stepped zooming 
frames obtained upon one shutter release operation may be 
other than four, e.g. two, three, five, six etc. Instead of the 
focus-locking, it is possible to automatically determine a 
main subject and focus on that main subject by use of a 

25 known main subject discrimination device. 

In the stepped focusing mode, a scene is photographed a 
plurality of times while varying focusing position of the 
imaging lens 22, that is, at different object distances. In this 
mode, a shortest subject distance and a longest subject 

30 distance are detected from several points of the scene, and 
a plurality of, e.g. four, object distances are determined 
stepwise from the shortest to longest subject distances of the 
scene. Then, the imaging lens 22 is stepwise moved to the 
focusing positions while one frame is photographed at each 

35 focusing position. A series of frames photographed in this 
way are recorded with data indicating that these frames have 
been taken as one unit in the stepped focusing mode, e.g. 
photographic data "FSP1" to "FSP4" for four steps of 
focusing. The number of focusing steps may be two, three, 

40 four, five and so on. 

In the stepped exposure value mode, a scene is photo- 
graphed a plurality of times while varying exposure value. 
In this mode, a lowest subject brightness and a highest 

45 subject brightness are detected from several points of the 
scene, so a maximum exposure value Emax and a minimum 
exposure value Emin are determined based on the lowest 
and highest subject brightness values within an available or 
capable exposure value range for the imaging device. Then, 

5Q the scene is photographed at a plurality of exposure values 
ranging from the maximum exposure value Emax to the 
minimum exposure value Emin, one frame at one exposure 
value. A series of frames photographed in this way are 
recorded with data indicating that these frames have been 

55 taken as one unit in the stepped exposure value mode, e.g. 
photographic data "FSE1" to "FSE4" for four steps of 
exposure values. 

In the successive exposure mode, a series of frames are 
photographed from a scene in a continuous succession. 

6 0 These successive frames are also recorded along with pho- 
tographic data representative of the successive exposure 
mode. 

In the pixel shifting mode, a plurality of frames is 
photographed from a scene, while the image of the scene 
65 formed on the imaging surface of the image area sensor 25 
is shifted for each frame vertically and horizontally by an 
amount less than the vertical and horizontal lengths of one 
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pixel of the image area sensor 25. These pixel shifted frames 
are also recorded along with photographic data representa- 
tive of the pixel shifting mode. 

As shown in FIG. 4, the digital printer unit 26 is consti- 
tuted of a data reading section 27, a process controller 28, an 5 
input image memory 29, an image processing section 30, a 
working memory 31, a color monitor 33, a frame memory 34 
and a printer 35. The digital printer unit 26 is installed in a 
photo-lab. The photographer forwards the IC memory card 
16 to the photo-lab, so photo prints are produced from the 10 
data recorded in the IC memory card 16. 

The IC memory card 16 is loaded in the data reading 
section 27, which reads the image data and the photographic 
data from the card 16. The image data is stored in the input 
image data memory 29. The photographic data is sent to and 15 
decoded by the process controller 28. 

The image processing section 30 processes or composes 
the image data in accordance with the photographic data. 
The image processing section 30 processes any image data 
by conventional image processing steps such as gammer 20 
correction, matrix conversion, letter-illustration composing, 
enlargement or reduction, data cropping or trimming. In 
addition, if the photographic data designates one of the fine 
photo mode, the image processing section 30 processes and 
composes the image data of a series of frames with reference 25 
to the working memory 31, to make a high definition photo 
print. The image data thus processed is sent to the color 
monitor 33 and the frame memory 34. The color monitor 33 
displays a video image simulating a photo print that would 
be produced from the processed image data. The image data 
stored in the frame memory 34 is used by the printer 35. 

According to an embodiment shown in FIG. 5, the printer 
35 is a Laser printer having an exposure section 40 which 
projects Laser beams of three primary colors while modi- 35 
fying the beams in accordance with the image data from the 
frame memory 34, to scan silver-salt color photographic 
paper 41 synchronously with transport of the paper 41. 
Three color photosensitive layers of the photographic paper 
41 are thus sequentially exposed to the Laser beams to 4Q 
record three color pixels of the image. The exposed color 
paper 41 is developed and finished through a paper proces- 
sor 44, and is cut into individual photo prints 45. 

The above photographic system consisting of the , digital 
still camera 10 and the digital printer unit 26 operates as 45 
follows: 

As shown in FIG. 6, the camera 10 discriminates the 
selected mode. If, for example, the divisional photo mode is 
selected, the camera 10 refers to the designated number of 
divisions. According to the present embodiment, the default 50 
number of divisions is four, and the photographer can also 
select one of two-, six-, eight-, nine- and twelve-division 
photograph. 

After the number of divisions is determined, the photog- 
rapher depresses the release button while framing the scene 55 
S. When the four-division photograph is selected, as shown 
in FIG. 2B, the imaging lens 22 is first moved into a position 
where the optical axis is placed in the center of the first 
division SI, and is zoomed at an image magnification ratio 
specific to the four-division photograph, so that the first 60 
division SI is photographed as the first frame FS1, as shown 
in FIG. 2C. Image data of the first frame FS1 is written in 
the IC memory card 16 along with the corresponding 
photographic data through the image processing section 12, 
the buffer memory 13 and the image data writing section 15. 65 
In the same way, the second to fourth frames FS2 to FS4 are 
photographed from the second to fourth divisions S2 to S4, 
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as shown in FIG. 2C, and image data of each of these frames 
FS2 to FS4 is sequentially written in the I C memory card 16 
along with the corresponding photographic data. 

When another mode of the fine photo mode is selected, a 
series of frames are photographed upon one shutter release 
operation in the way as set forth above, and image data of 
each frame is sequentially written in the IC memory card 16 
along with the corresponding photographic data. 

When the ordinary photo mode is selected, a frame is 
photographed upon one shutter release operation, and image 
data of the ordinary frame is written in the I C memory 16 in 
the sequence of exposure, along with photographic data 
indicating that the frame has been taken in the ordinary 
photo mode. 

In the photo-lab, the image data read out from the IC 
memory card 16 is written in the input image data memory 
29 in the sequence of recording. The photographic data read 
out from the IC memory card 16 is written in a buffer 
memory 28a of the process controller 28 in the sequence of 
recording. 

When it is determined from the associated photographic 
data that the image data is of an ordinary frame, the image 
data is processed in the conventional way through the image 
processing section 30, and the processed image data is 
written in the working memory 31. Based on the processed 
image data, a video image simulating a subsequent photo 
print is displayed on the color monitor 33, so the photog- 
rapher can decide whether the frame is to be printed or not, 
if necessary, after correcting printing conditions. When the 
frame is decided to be printed, its image data is written in the 
frame memory 34. Then, the printer 35 makes a photo print 
of an ordinary quality from the image data. 

When the photographic data represents the divisional 
photo mode, the image data of the first frame FS1 is written 
in a first location of the working memory 31 that corre- 
sponds to the first division SI. The image data of the second 
frame FS2 is written in a second location of the working 
memory 31 that corresponds to the second division S2. The 
image data of the third frame FS3 is written in a third 
location of the working memory 31 that corresponds to the 
third division S3. The image data of the fourth frame FS4 is 
written in a fourth location of the working memory 31 that 
corresponds to the fourth division S4. As a result, the 
working memory 31 is written with image data of the entire 
scene S, wherein border positions between the divisions SI 
to S4 are corrected by subjecting the image data of the 
frames FS1 to FS4 to a conventional local pattern matching 
process. The image data of the entire scene S obtained in this 
way is written in the frame memory 34. Since the number of 
pixels used for photographing one scene is higher than, i.e. 
quadruple, that used in the ordinary photo mode, the resolv- 
ing power is correspondingly higher than ordinary, so the 
grain fineness of the photo print is improved. 

When the photographic data represents the stepped zoom- 
ing mode, the image processing section 30 first reads the 
image data of the first zooming frame FSZ1 from the input 
image memory 29, and writes it in the working memory 31 
in the way as shown in FIG. 3D. As the working memory 31 
consists of a greater number of pixels than that used for 
photographing the first photographic field SZ1, interpolation 
is performed. Then, the image data of the second zooming 
frame FSZ2 is read and processed for pattern-matching with 
the image data of the first zooming frame FSZ1 by use of 
data representative of main subject position and magnifica- 
tion ratio of the second zooming frame FSZ2. Thereby, the 
image data of the second zooming frame FSZ2 takes the 
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place of those image data pieces of the first zooming frame 
FSZ1 which are taken from the same scene area as the 
second photographic field SZ2. Next, among the image data 
of the second zooming frame FSZ2, those image data pieces 
taken from the same scene area as the third photographic 
field SZ3 are replaced with the image data of the third 
zooming frame FSZ3 through the pattern-matching opera- 
tion. In the same way, the image data of the fourth zooming 
frame FSZ4 is composed with the image data of the third 
zooming frame FSZ3 by pattern-matching. In this way, the 
first to fourth zooming frames FSZ1 to FSZ4 are composed 
in the way as implied by phantom lines in FIG. 3D. Since the 
fourth zooming frame FSZ4 is photographed at the highest 
resolution, the resolution of the composite image is the 
highest in the main subject area, and lowered toward the 
peripheral area. 

When the photographic data represents the stepped focus- 
ing mode, focusing conditions of each of a series of stepped 
focusing frames are detected by differentiating each pixel 
with peripheral pixels. Because the differential values 
decrease as the image goes out of focus, it is possible to 
extract in-focus areas from the individual frames based on 
the differential values. Then, those image data pieces 
involved in the in-focus areas are written in the working 
memory 31 such that the in-focus areas of the respective 
frames are composed into an image. That is, the whole area 
of the composite image is in focus. In this way, it is possible 
to photograph a totally in-focus picture, especially a 
landscape, regardless of the depth of field of the imaging 
lens 22. 

Instead of using pixel values of those pixels involved in 
the in-focus areas, a weighted average of the pixels' values 
of the same position in the respective frames may be used as 
a pixel value of that position in the composite image. In that 
case, a largest weighting coefficient should be used for those 
pixels involved in the in-focus areas. 

When the photographic data represents the stepped expo- 
sure value mode, luminance values of a frame that is taken 
at a middle exposure value of the used exposure values are 
detected, and those areas where the luminance values are 
above a predetermined value are eliminated by use of a 
histogram method or a simple threshold value or another 
conventional method. In the same way, those areas of the 
middle exposed frame where the luminance values are 
below a predetermined value are eliminated. For the elimi- 
nated areas, those pixel values within the range between the 
predetermined values, which are selected from correspond- 
ing areas of any of other relating frames, are used. It is 
possible to control gradation of each of the high luminance 
range, the middle luminance range and the low luminance 
range in view of density balance of the entire scene by 
processing the image data through clipping, range- 
confining, gradation-conversion within each range or the 
like. This is effective to avoid density unbalance in the 
composite image, e.g. lower image density in an actually 
higher brightness area of the scene than that in an actually 
lower brightness area. According to the stepped exposure 
value mode, it is possible to prevent over-exposure in high 
brightness areas of the scene and under-exposure in low 
brightness areas of the scene: white compression, black 
compression, or under-exposure of a main subject in a 
back-lit photography. 

When the photographic data represents the successive 
exposure mode, an image of the scene photographed in this 
mode is composed of average values or middle values of the 
corresponding pixels of the successive frames. Because of 
the performance of the imaging device, the original pixel 
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values stiffer from noise. By averaging image data of the 
successively photographed frames, S/N ratio of the image 
data is reduced. For a distant low brightness subject which 
cannot be illuminated by a flash light, a better image quality 

5 is obtained by the successive exposures. Since it is possible 
to reduce the amount of illumination light for one exposure, 
it is possible to avoid over-exposure due to over- 
illumination. A shorter shutter speed is necessary for one 
exposure compared with a single exposure even when the 

10 subject brightness is low. Therefore, hand -shaking is 
prevented, and thus the image quality is improved. 

When the photographic data represents the pixel shifting 
mode, the image data of a series of frames are composed to 
virtually increase the resolution of the consequent image 

35 relative the resolving power of the image area sensor 25. 
The composed or ordinarily processed image data is 
transferred from the working memory 31 to the frame 
memory 34. The printer 35 makes a photo-print based on the 
image data from the frame memory 34. 

20 The present invention is applicable to a silver-salt pho- 
tographic camera. In that case, a series of frames of one 
scene are photographed on a silver-salt photo filmstrip, and 
corresponding photographic data is recorded in an IC 
memory card, on magnetic recording medium such as mag- 

25 netic tape or magnetic track on the photo filmstrip, or 
through optical recording device. In order to make a photo- 
print from the series of frames, image data of these frames 
is picked up by a scanner from the developed photo 
filmstrip, and the image data is processed and composed 
according to the photographic data in the same way as 
described above. 

It is possible to omit the lens shifting device 23 and frame 
the respective divisions by hand after entering the number of 

35 divisions. In that case, borders between the divisions are 
adjusted by pattern-matching on the side of a digital printer. 
This embodiment is preferable for compactness and simple 
structure of the camera. 

Also in the stepped zooming mode, it is possible to move 

40 the imaging lens 22 stepwise to a number of zooming 
positions by hand, instead of the above automatic zooming. 
In that case, pattern -matching between the step-zoomed 
frames of the same subject should be carried out to produce 
a composite image, 

45 The exposure section 40 may be of area-exposure type or 
line-exposure type using an CRT screen or a LCD panel. As 
another scanning-exposure type, a micromirror device may 
be used for the exposure section 40. The micromirror device 
is a spatial modulator consisting of micro mirrors arranged in 

50 an array or a matrix, and the tilt angle of the individual 
micromirror is controlled to deflect incident light. If a 
negative -to-positive type photographic paper is used, the 
image data should be subjected to a well-known positive - 
to -negative conversion in the image processing section 30 or 

55 in the printer 35, 

The printer 35 is not to be limited to the color Laser 
printer using silver-salt photographic paper, but may be any 
kind of printer which makes prints based on digital image 
data, including a color thermal transfer printer, a color 

60 ink-jet printer, a color thermosensitive printer, and a color 
* Laser printer using ordinary paper. 

FIG. 7 shows a camera used in a photographic system 
according to another embodiment of the invention. An 
imaging lens 50 can be manually or automatically focused. 

65 A program-controlled shutter mechanism 52 is disposed 
behind the imaging lens 50. For example, the shutter mecha- 
nism 52 is constituted of a pair of shutter blades 53 and 54 
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and a shutter driver 55 which moves a movable pin 56 According to the present embodiment, the photographer 

toward a stationary pin 57 to open the shutter blades 53 and can choose between photosensitive paper and ordinary 

54 for exposing a photo filmstrip 58. paper. When ordinary paper is chosen, the frame is printed 

The imaging lens 50, the shutter mechanism 52 and other on ordinary paper through an ink-jet printer, as set forth later 

not-shown mechanisms of the camera are sequentially con- 5 m detail. 

trolled by a system controller 60 that may be a well-known The combination-printing data consists of frame number 

microcomputer. Each time a release switch 61 is actuated, data designating a frame to combine the literal image 

the system controller 60 makes an exposure, advances the therewith, and position data designating a position of the 

filmstrip 58, and records various photographic data on literal image in the ordinary frame. In this embodiment, the 

transparent magnetic recording track. In the shown 10 frame number data represents a particular frame number 

embodiment, the magnetic recording track is formed on the designated by the photographer, or in default of manual 

back surface of the photo filmstrip 58, but it may be formed designation of the frame number, the frame number data 

on the front surface. The filmstrip 58 is able to advance out designates the frame preceding to the frame containing the 

of a cassette shell 59 after the entire length is wound into the literal image to combine. It is possible to designate a 

cassette shell 59. The filmstrip 58 is provided with a pair of ]5 plurality of frames with which the literal image is to be 

perforations 63 per frame, so the individual frame can be combined. 

positioned with reference to the perforations 63. As the position data, inside position data for designating 

The camera further has a code converter 62, a photo- a position inside the frame, outside position data for desig- 

graphic data generator 65 and an auto-dating section 66. The nating a position outside the frame or backside position data 

photographic data generator 65 receives signals from the 20 for designating a position backside of the frame may be 

system controller 60 and other not-shown sensors and gen- recorded. The inside position data designates center, upper 

erates from the signals photographic data such as data of right, lower right, upper left or lower left of the print frame, 

light source type, data of focal length of the imaging lens 50, The outside position data designates upper margin, lower 

data of subject distance, and data of whether flash light is margin, right margin or left margin of the print frame. For 

used or not. As the photographic data, literal photo data 25 example, when the backside position is designated by the 

indicating that an assigned frame contains a literal image combination-printing data, the literal image is printed on the 

may be recorded. The auto-dating section 66 sends date-of- backside of the print frame through a backside printer. The 

photography data and the like to a not-shown date printer, backside printer is preferably a conventional one provided 

and also to the code converter 62. for printing the frame number or print-exposure correction 

The code converter 62 receives the number of exposed 30 data relating to the print frame, 

frames from the system controller 60, and codes the various The filmstrip 58 exposed by the above camera is devel- 

photographic data for each exposed frame with reference to oped and then placed in a film carrier 141 of a printer- 

a coding standard stored in a built-in memory 62a. The processor 140 (see FIG. 9). The film carrier 141 is provided 

coded photographic data is sent to a data writing section 70. with an imaging aperture 142, a printing aperture 143 and 

The data writing section 70 drives a magnetic writing head 35 feed roller pairs 144. The film carrier 141 positions the 

71 during the one-frame advancing after each exposure, to individual frames on the filmstrip 58 in the imaging aperture 

write the coded photographic data on a magnetic recording 142 and then in the printing aperture 143 turn by turn with 

track 58a of the photo filmstrip 58, as shown in FIG. 8A. A reference to the perforations 63. The feed roller pairs 144 

preferable coding method for the photographic data to transports the filmstrip 58 such that a loop is formed between 

record on the magnetic track 58a on the photo filmstrip 58 40 the two apertures 142 and 143. 

is disclosed in JPA 4-113347, corresponding to U.S. appli- A magnetic reading head 145 is disposed in the film 

cation Ser. No. 08/1 28,568. The magnetic head 71 may carrier 141 at an upstream position of the imaging aperture 

alternatively be driven during the film rewinding into the 142, for reading the photographic data from the magnetic 

cassette shell 50 after all available frames of the filmstrip 58 recording tracks 58a of the filmstrip 58. The photographic 

are exposed, to write the photographic data of the respective 45 data is sent through a decoder 146 to a controller 147. The 

frames successively. For this embodiment, it is necessary to controller 147 sequentially controls all components of the 

store the photographic data of all frames in the memory 62a printer-processor 140. A magnetic writing head 148 is dis- 

by the time of rewinding. posed at a downstream position of the printing aperture 143. 

The system controller 60 operates in one of at least an The writing head 148 is driven by a magnetic recording 

ordinary photo mode and a literal photo mode. In the 50 section 149 to write print data on magnetic recording tracks 

ordinary photo mode, each scene is photographed in an provided therefor on the filmstrip 58. The print data includes 

ordinary way and, if necessary, the photographic data is data of photo-lab ID number, print-exposure correction 

recorded on the magnetic recording track 58a. The literal values, and date of film development, 

photo mode is selected for a scene where letters or characters Light source sections 151 and 152 are disposed on the 

exist when the photographer wishes to reproduce the letters 55 opposite side of the filmstrip 58 from the printing aperture 

or characters at a high resolution in the print. Along with 143 and the imaging aperture 142 respectively. The light 

those frames taken in the literal photo mode, the literal photo source section 152 for printing light consists of a white light 

data is recorded. source 153, a light controller 154, and a diffusion box 155. 

Besides fine printing data designating the literal image The light controller 154 controls insertion of three color 
contained in the frame to be printed at the high resolution, 60 filters 156, 157 and 158 into a printing light path, thereby to 
the literal photo data includes paper type data designating a control quality and quantity of the printing light. The con- 
recording paper type. As the literal photo data, combination- trolled printing light is diffused through the diffusion box 
printing data requiring the literal image be printed in com- 155, to equally illuminate each frame on the photo filmstrip 
bination with another frame is optionally recorded. The 58 when placed in the printing aperture 143. The light source 
photographer can designate a recording paper type and/or a 65 section 152 is constituted of a white light source 160 and a 
combination printing type of the literal image before or after diffusion box 161, and illuminates each frame when it is 
each exposure in the literal photo mode, placed in the imaging aperture. 



11/20/2003, EAST version: 1.4.1 



US 6,583 : 

11 

The printing light travels through the frame positioned in 
the printing aperture 143 and is focused through a printing 
lens 166 and a mirror 167 onto color photographic paper 169 
in a printing stage 168 only while a shutter 165 is opened by 
a shutter driver 165a. Through paper feed roller pairs 170, s 
171 and 172, the photographic paper 169 is withdrawn from 
a magazine 173, and is positioned in a letter printing stage 

174 and then in the printing stage 168. 

The light travels through the frame positioned in the 
imaging aperture 142 and is received on an imaging device 10 

175 for picking up image data of that frame, and is also 
received on an image scanner 176 which measures three 
color light values of each pixel of the frame. The image data 
from the imaging device 175 is stored in an image memory 
177. The photometric values from the image scanner 176 are 15 
used for calculating characteristic values of each color, such 

as LATD, maximum and minimum values. Based on the 
characteristic values, a print-exposure amount operator 179 
calculates print-exposure amounts by use of conventional 
operations. The controller 147 determines based on the 20 
print-exposure amounts the positions of the color filters 156 
to 158 in the printing light path 154, so the light controller 
159 inserts the filters 156 to 158 into the determined 
positions of the printing light path 159. 

When the literal photo data is assigned, the image data 25 
stored in the image memory 177 is processed in an image 
processing section 180 to improve the contrast and resolu- 
tion of the literal image, by use of one or several methods: 
edge-enhancement, binarization or conversion into binary 
image, monochromization or conversion into black-and- 30 
white image, and so forth. The processed image data of the 
literal image is stored in an image buffer 181 along with the 
literal photo data. It is possible to delete the background and 
extract data of the literal image. For example, an area 
containing the letters may be extracted by pattern-matching 35 
or other method. By deleting data'of remaining areas, data 
of the literal image can be extracted. 

A letter printing device 183 is disposed in the letter 
printing stage 174. The letter printing device 183 is consti- 4Q 
tuted of a light source unit 184, an LCD panel 185, a printing 
lens 186 and an LCD driver 187. The LCD driver 187 is 
connected to the output of the image buffer 181. The light 
source unit 184 consists of red, green and blue LEDs 184a, 
184b and 184c, which illuminate the LCD panel 185 through 45 
mirror 184rf. The LCD panel 185 is driven by the LCD 
driver 187 based on the literal image data stored in the image 
buffer 181, so as to display a negative literal image. A 
negative literal image is formed onto the photographic paper 
169 from the light from the LCD panel 185 through the 5Q 
printing lens 186, so that the literal image is recorded on the 
photographic paper 169. 

The output of the image buffer 180 is also connected to an 
ink-jet printer 190 for printing the literal image in a positive 
form on ordinary paper 191 when ordinary paper is selected 5S 
as the recording paper type. By printing the literal image on 
ordinary paper, the consequent hard copy is useful as a 
document, and it becomes possible to write in appropriate 
phrases on the side of the literal image. 

The printer-processor 140 is further provided with a 6 o 
backside printer 192 for printing frame number or exposure 
correction data on the backside of photo print. For those 
frames which the backside print is designated by the letter 
photo data, the literal image is printed on the backside of the 
photographic paper 169 by the backside printer 192. 65 

The exposed photographic paper 169 is developed by a 
paper processor 193, and is cut into individual photo prints 
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194. Designated by 195 is a tray, and 196 and 197 are paper 
loop reservoirs. Designated by 198 is a paper cutter for 
cutting an exposed portion of the photographic paper 169 
from an unexposed portion when printing is interrupted. 

The operation of the photographic system of the second 
embodiment will now be described. 

Referring to FIG. 10, when a not-shown power switch of 
the camera of FIG. 7 is turned on, first the photo mode is to 
set up. Thereafter when the release switch 61 is turned on, 
an exposure is effected on the photo filmstrip 58. If the literal 
photo mode is selected, the type of recording paper, or the 
combination-printing position of literal image, or other 
commands may be manually entered after the exposure. 
During one-frame advance after the exposure, photographic 
data relating to the just exposed frame is recorded on the 
magnetic recording track 58c. If the literal photo mode is 
selected, the literal photo data is included in the photo- 
graphic data. The exposed photo filmstrip 58 with the 
magnetic data is forwarded to a photo-lab. 

In the photo-lab, the filmstrip 58, after being developed, 
is set in the film carrier 141. As shown in FIG. 11, first the 
photographic data is read out from the magnetic track 58a 
through the magnetic reading head 145. When the photo- 
graphic data includes the literal photo data to indicate that 
the frame contain a literal image, the imaging section 175 
picks up image data from that frame. The image data is 
stored in the image memory 177 and then processed in the 
image processing section 180, to improve the resolution and 
make the literal image clear and definite. 

For ordinary frames, three color light values are detected 
through the scanner 176, and the ordinary frames are seria- 
tim positioned in the printing aperture 143, to print the 
image onto the photographic paper 169 at the ordinary 
printing stage 168. 

FIG. 8 A shows an example wherein frames 101, 102, 103 
and 104 are recorded on the filmstrip 158 in this sequence, 
and the first and third frames 101 and 103 are taken in the 
ordinary photo mode, whereas the second and fourth frames 
102 and 104 are taken in the literal photo mode. For 
example, the photographic data relating to the second frame 
102 includes combination-printing data that designates a 
literal image contained in the second frame 102 to be merged 
in the upper-left position of the first frame 101. In that case, 
image data of the second frame 102 is picked up by the 
imaging device 175, and image data of the literal image of 
the second frame 102 is extracted in the image processing 
section 180. Based on the image data of the literal image of 
the second frame 102 stored in the buffer memory 181, the 
LCD driver 187 drives the LCD 185 of the letter printing 
device 183 to print a literal image 111 on the photographic 
paper 169 at the upper-left position of a print frame in the 
letter printing stage 174. Thereafter, an image 110 of the first 
frame 101 is superimposed on the literal image 111, thereby 
providing a photo print 112 as shown in FIG. 8B. 

Since the third frame 103 is an ordinary frame, an 
ordinary photo print 113 as shown in FIG. 8C is made from 
the third frame 103. 

When the literal photo mode data relating to the fourth 
frame 104 designates ordinary paper as the recording paper, 
the image data of the fourth frame 104 stored in the image 
buffer 181 is sent to the ink-jet printer 190, which makes a 
print or hard copy 114 of the fourth frame 104 on the 
ordinary paper 191. 

On the other hand, when the photographic paper is 
selected as the recording paper for a frame taken in the literal 
photo mode, a literal image is printed on the photographic 
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paper 169 through the letter printing section 183. But when 
the backside printing is designated, the literal image is 
printed by the backside printer 192 on the backside of the 
photographic paper 169. Even a frame containing a literal 
image, if the literal photo data is not recorded, the frame is 5 
printed at the ordinary printing stage 168. 

The literal image picked up through the imaging device 
175 may be processed by a conventional character recogni- 
tion software, instead of the above image processing steps 
like edge-enhancement, binarization and monochromiza- 10 
tion. Thereby, word-processing such as font selection is 
possible for the ink-jet printer 190, the backside printer 192, 
and the letter printing device 183 as well. 

As the letter printer 183, it is preferable to use an LCD 
printer that has conventionally been used for index -printing. 15 
The LCD panel 185 may be replaced by a line LCD for 
printing the literal image line after line. A CRT may be 
substituted for the LCD panel 185. A Laser printer may be 
useful for other types of letter printing devices. As other 
options of letter printers, there are a thermal transfer type 20 
printer and a thermosensitive type printer. 

The second embodiment is applicable to a photographic 
system consisting of a digital still camera and a digital 
printer. In that case, the photographer can process image 
data of a photographed literal appropriately through a per- 25 
sonal computer. It is also possible to provide the digital still 
camera with a function to convert literal image data into a 
document. 

The photo filmstrip 158 may be transported back and forth 
through the film carrier 141 of the printer-processor 140 30 
such that the imaging device 175 and/or the scanner 176 
picks up the individual frames on the filmstrip 158 in one 
way, and the printing is carried out during the transport in the 
opposite way. It is also possible to transport the filmstrip 158 
one way but twice through the film carrier 141, such that the 35 
image data is picked up during the first transport, and that the 
printing is carried out during the second transport. 

It is possible to compose a plurality of literal images into 
a hard copy or photo print. In that case, the plurality of literal 
images can be photographed from a plurality of originals or 40 
divisional portions of the same original. In the latter case, the 
literal images are composed by a conventional pattern- 
matching. 

The literal photo mode data may be recorded in an IC ^ 
memory card or another storage device, or may be optically 
recorded on the photo filmstrip. 

Thus, the present invention should not be limited to the 
above embddiments but, on the contrary, various modifica- 
tions may be possible to those skilled in the art without 5Q 
departing from the scope of claims attached hereto. 

What is claimed is: 

1. A photographic system consisting essentially of a 
camera and a printer, the camera comprising: 

a taking lens for forming an image in a frame of a film 55 
strip; 

a mode selection device for selecting one of an ordinary 
photo mode and a literal photo mode for forming a 
literal image through said taking lens in said frame of 
said film strip; and 60 

a data recording device for recording literal photo data on 
a recording track of a film strip in association with 
frames of the film strip photographed in the literal 
photo mode, 

wherein the printer comprises: 65 
a data reading device for reading the literal photo data 
from the recording medium; 



an image processing device for processing image data 
detected from one frame associated with the literal 
photo data, so as to improve resolution and sharpness 
of the literal image contained in the one frame; and 

a printing device for printing a hard copy of the literal 
image based on the processed image data. 

2. A photographic system as claimed in claim 1, wherein 
the printer comprises: 

a data reading device for reading the literal photo data 
from the recording medium; 

an image processing device for processing image data 
detected from one frame associated with the literal 
photo data, so as to improve resolution and sharpness 
of the literal image contained in the one frame; and 

a printing device for printing a hard copy of the literal 
image based on the processed image data. 

3. A photographic system as claimed in claim 2, wherein 
the image processing device subjects the image data to at 
least one of edge-enhancement, binarization and mono- 
chromization. 

4. A photographic system as claimed in claim 3, wherein 
the literal photo data includes data of a recording paper type 
to use for printing the literal image, and the printer deter- 
mines the type of the printing device for the literal image in 
accordance with the recording paper type data. 

5. A photographic system as claimed in claim 3, wherein 
the literal photo data includes combination-printing data 
designating a frame to print in combination with the literal 
image and a position of the literal image relative to the 
designated frame, and the printer prints the literal image in 
the designated position in accordance with the combination- 
printing data. 

6. A photographic system as claimed in claim 5, wherein 
a printed position of the literal image can be one of inside the 
designated frame, on a margin of the designated frame, and 
backside of recording paper of the designated frame. 

7. A photographic system as claimed in claim 6, wherein 
the literal image is merge-printed with an image of the 
designated frame when the combination-printing data des- 
ignates a position inside the designated frame. 

8. A printer comprising: 

a data reading device for reading photographic data 
relating to each individual frame to print from a record- 
ing medium, the photographic data being recorded by 
a camera; 

an image processing device for processing image data of 
a plurality of frames photographed from a same scene 
to compose a high definition image when the photo- 
graphic data indicates correlation between the plurality 
of frames; and 

a printing device for printing a hard copy of the high 
definition image. 

9. A camera comprising: 

a taking lens for forming an image in a frame of a film 
strip; 

a mode selection device for selecting one of an ordinary 
photo mode and a literal photo mode for forming a 
literal image through said taking lens in said frame of 
said film strip; and 

a data recording device for recording photographic data 
relating to each individual frame of a film strip, the 
photographic data including literal photo data for 
frames photographed in the literal photo mode, the 
literal photo data indicating that the frames contain a 
literal image each and that the literal image is to be 
printed with high resolution. 
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10. A printing method comprising the steps of: 
reading photographic data from a recording medium, the 

photographic data being recorded on said recording 

medium through a taking lens of a camera; 
discriminating one frame of a film strip when the photo- 5 

graphic data of the one frame indicates that the one 

frame contains a literal image formed through said 

taking lens of said camera; 
processing image data of the one frame so as to improve J0 

resolution and sharpness of the literal image; and 
making a hard copy of the literal image based on the 

processed image data, 

11. A printing method as claimed in claim 10, wherein the 
processing step includes at least one of edge-enhancement, 15 
binarization and monochromization. 

12. A photographic system consisting essentially of a 
camera and a printer, the camera comprising: 

a taking lens for forming an image in a frame of a film 
strip; 20 

a mode selection device for selecting one of an ordinary 
photo mode and a literal photo mode, wherein when in 
the ordinary mode the camera photographs an image as 
an individual frame, and when in the literal mode the 
camera forms a literal image through said taking lens in 25 
said frame of said film strip; 

a data recording device for recording literal photo data on 
a recording medium in association with frames photo- 
graphed in the literal photo mode, wherein the literal 
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photo data includes combination-printing data which 
designates a frame photographed in the literal mode to 
print in combination with one of another frame photo- 
graphed in the literal mode and a frame photographed 
in the ordinary mode so that the printer prints the literal 
image in a designated position in accordance with the 
combination-printing data. 

13. The photographic system of claim 12, wherein a film 
strip contains the individual frame photographed in the 
ordinary mode and the individual frame photographed in the 
literal mode. 

14. A printer comprising: 

a data reading device for reading photographic data 
relating to each individual frame to print from a record- 
ing medium, the photographic data recorded on said 
recording medium through a taking lens of a camera; 

an image processing device for processing image data of 
a plurality of frames of a film strip to compose a high 
definition image when the photographic data indicates 
a correlation between the plurality of frames, the image 
data indicating one of an ordinary image and a literal 
image, wherein when the correlation is indicated, a 
frame containing a literal image formed through said 
taking lens of said camera is merged with a frame 
containing an ordinary image; and 

a printing device for printing a hard copy of the high 
definition image. 

***** 
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